1 



- 1 - 



TITLE OF THE INVENTION 

IMAGE PROCESSING APPARATUS EFFECTIVE FOR PREVENTING 
COUNTERFEITING OF A COPY-PROHIBITION OBJECT 

5 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[000 1] The present invention relates to an image processing apparatus 
10 suitable for preventing counterfeiting of copy-prohibition objects, such as 
paper money, securities and the like. 
Description of the Related Art 

[0002] Recently, it has been proposed to mount in a color copier an image 
recognition processing function or the like for preventing counterfeiting of 

15 paper money, securities and the like. That is, when image data to be copied is 
determined to represent an image for which counterfeiting is to be prevented, 
normal copy output of the image is prevented, for example, by (l) providing 
print output by painting the entire image with a certain color, (2) providing 
print output by superposing a certain symbol or figure on the image, (3) 

20 providing print output by changing the color or the image size, or (4) 
providing no print output. 

[0003] A copier is basically designed to faithfully copy an object mounted 
on an original-mount, except for a copy -prohibition object, such as paper 
money or the like. Accordingly, if an image which resembles paper money (an 
25 image other than paper money which can be legally copied) is input, the 
copier must recognize that the image is not paper money, and perform a 
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copying operation of the original image. Hence, very precise recognition 
accuracy is requested for determining whether or not an image to be 
recognized is an image for which counterfeiting is to be prevented. 
[0004] Recently, the quality of an image obtained by a color scanner or a 
5 color printer which is less expensive than a color copier is greatly improved, 
and it becomes possible to perform a counterfeiting operation by connecting 
such an apparatus to a personal computer, i.e., by combining apparatuses 
jj other than a color copier. Accordingly even in an image processing system 

^? using an inexpensive color scanner or color printer, countermeasures for 

€1 20 preventing counterfeiting of paper money, securities and the like by mounting 

01 an image recognition function or the like have been desired, 

[0005] Various methods for determining whether or not an original is a 
j*f copy-prohibition object have been proposed. In one method, a color spectrum 

.0 distribution of image data obtained by scanning an original is compared with 

q 15 data registered in advance in a ROM (read-only memory), based on each pixel 

value (a set of R, G and B values corresponding to three color signals) in the 
image data (for example, by obtaining a sum of the absolute values of 
difference values between respective pixel values and stored data, or 
calculating a cross -correlation value between distributions). In another 
20 method, an evaluation value is calculated by comparing a synthetic image 
pattern of a part or the entirety of an original with pattern data registered in 
advance in a ROM or the like. 

[0006] Recently, it becomes possible to incorporate information indicating 
a copy-prohibition object within an original, serving as a printed matter, 
25 using a technique called "digital watermark". That is, when printing an 
original, serving as a copy-prohibition object, a printed matter is obtained 
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from image data (electronic image information) including 
copy-prohibition-object information generated by embedding second digital 
information (sub-information) indicating a copy-prohibition object in image 
data (electronic image information), serving as original first digital 

5 information (main information). This copy-prohibition-object information 
(sub -information) can be extracted from the image data including the 
copy-prohibition-object information before printing the original. Furthermore, 
if consistency between conditions when forming the printed matter from the 
imasre data (electronic iiusss information) including the 

10 copy-prohibition-object information and conditions in reading and extraction 
processing is obtained, it is also possible to extract the copy-prohibition-object 
information from electronic image data obtained by reading the printed 
matter (original) formed from electronic image information including the 
copy-prohibition-object information by an original-reading device, such as a 

15 color scanner or the like. In consideration of these features, application of the 
technique called "digital watermark" to prevention of illegal copying of an 
original, serving as a printed matter, has been attracting notice. 
[0007] However, as described above, in order to extract digital-watermark 
data embedded using the digital watermark technique, it is necessary to 

20 obtain consistency between conditions in reading and extraction and how 
watermark information is embedded in original-image data (i.e., at what 
position and with what arrangement in the original-image data the 
watermark information is embedded). 

[0008] Accordingly, when reading a printed matter (an original) formed 
25 from electronic image information having embedded digital-watermark 
information by an original-reading device, such as a color scanner or the like, 



in what direction the original is mounted on the surface of an original-mount 
greatly influences difficulty in extraction of digital-watermark information. 
[0009] When realizing processing of recognizing a copy-prohibition object 
by comparing a color spectrum distribution of image data obtained by 
scanning an original with data registered in advance in a ROM, or 
calculating an evaluation value by comparing a synthetic image pattern of a 
part or the entirety of the original with pattern data registered in advance in 
a ROM or the like, if the direction (angle) or the position of the mounted 
original is not fixed, the total amount of calculation operations for 
comparison with spectrum data registered in advance or image-pattern data 
tends to greatly increase in order to deal with various directions and 
positions. 

[0010] In an inexpensive color scanner or color printer, it is desirable to 
realize prevention of counterfeiting of a copy-prohibition object with a cost 
lower than in the case of using a relatively expensive color copier. For that 
purpose, it is preferable to realize a function of recognizing a copy-prohibition 
object by mainly using software instead of mainly using hardware having a 
large amount of electronic circuits and the like. 

[0011] On the other hand, if it is intended to determine a copy-prohibition 
image requiring precise recognition accuracy mainly by software, since the 
total amount of calculation operations is large, the processing time required 
for the recognition and determination tends to be greatly increased. 
[0012] That is, if it is intended to reduce the amount of calculation 
operations for the recognition and determination, it generally tends to be 
difficult to realize determination of a copy-prohibition image requiring 
precise recognition accuracy such that, for example, it becomes difficult to 
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detect a copyprohibition object, such as paper money or the like, read by 
intentionally changing reading conditions (such as a mounting angle or a 
mounting position of an original on a reading surface), or that when an image 
resembling paper money (an image other than paper money which is legally 
5 allowed to be copied) is input, the image is erroneously recognized as a 
copy-prohibition image and normal image output is not performed, thereby 
impairing the original function of an image processing system. 

SUMMARY OF THE INVENTION 

10 

[0013] It is an object of the present invention to provide an image 
processing apparatus and a method for controlling the same in which the 
above-described problems are removed. 

[0014] It is another object of the present invention to provide an image 
15 processing apparatus and a method for controlling the same which allow 
recognition whether or not an image is a copy-prohibition object that is more 
precise than in the prior art, even in recognition/determination processing 
having a relatively small amount of calculation operations in a personal 
computer system using an inexpensive image scanner or color printer. 
20 [0015] According to one aspect, the present invention which achieves 
these objectives relates to an image processing apparatus including 
image- data input means for inputting image data, specific-image 
determination means for determining whether or not the image data 
obtained by the image-data input means represents a specific image having 
25 predetermined characteristics, re-input determination means for 
determining whether or not a signal urging re "input of the image data 




obtained from the image-data input means is to be output, and signal output 
means for outputting the signal urging re-input of the image data, in 
accordance with a result of the determination by the re-input determination 
means. 

5 [0016] According to another aspect, the present invention which achieves 
these objectives relates to a method for controlling an image processing 
apparatus. The method includes the steps of inputting image data, 
determining whether or not the image data obtained in the image-data input 
step represents a specific image having predetermined characteristics, 

10 determining whether or not a signal urging re-input of the image data 
obtained in the image-data input step is to be output, and outputting the 
signal urging re-input of the image data, in accordance with a result of the 
determination in the re -input determination step. 

[0017] According to still another aspect, the present invention which 
15 achieves these objectives relates to a storage medium, capable of being read 
by a computer, storing a program to cause an image processing apparatus to 
execute the following steps. The program includes the steps of inputting 
image data, determining whether or not the image data obtained in the 
image-data input step represents a specific image having predetermined 
20 characteristics, determining whether or not a signal urging re-input of the 
image data obtained in the image-data input step is to be output, and 
outputting the signal urging re-input of the image data, in accordance with a 
result of the determination in the re-input determination step. 
[0018] The foregoing and other objects, advantages and features of the 
25 present invention will become more apparent from the following detailed 
description of the preferred embodiments taken in conjunction with the 



accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

5 [0019] FIG. 1 is a block diagram illustrating the configuration of an image 
processing apparatus according to the present invention; 

[0020] FIG. 2 is a diagram illustrating an image processing system 
according to a first embodiment of the present invention; 

iuuzjlj r ivr. 6 is a sjiocii uiagram hills* Lifting u>e coi±±±g u> a l±^h ui a 
10 principal portion of the system shown in FIG. 2; 

[0022] FIG. 4 is a flowchart illustrating operation procedures in the 
configuration shown in FIGS. 2 and 3; 

[0023] FIG. 5 is a flowchart illustrating operation procedures in a third 
embodiment of the present invention; 
15 [0024] FIG. 6 is a diagram illustrating a state of four corners of an 
original in the third embodiment; 

[0025] FIG. 7 is a diagram illustrating an image processing system 
according to a sixth embodiment of the present invention; 
[0026] FIG. 8 is a block diagram illustrating the configuration of a 
20 principal portion of the system shown in FIG. 7; 

[0027] FIG. 9 is a diagram illustrating the configuration of an image 
processing apparatus according to a seventh embodiment of the present 
invention! 

[0028] FIG. 10 is a flowchart illustrating operation procedures in the 
25 configuration shown in FIGS. 2 and 3 according to the seventh embodiment; 
and 
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[0029] FIG. 11 is a flowchart illustrating another operation procedures in 
the seventh embodiment. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

5 

[0030] Preferred embodiments of the present invention will now be 
described in detail with reference to the drawings. 

[0031] An image processing apparatus proposed in the following 

embodiments of the present invention includes, as shown in FIG. 1, an 
10 image-data acquisition unit 120 for inputting image data from an image-data 
source 110, such as a color scanner or the like, a copy-prohibition-object 
recognition unit 130 for determining whether or not the image data obtained 
by the image-data acquisition unit 120 is image data obtained by reading a 
copy-prohibition object, a retry determination unit 160 including a difficulty 
15 calculation unit 140 for calculating difficulty in determination whether or not 
the image data represents a copy-prohibition object, and a difficulty 
determination unit 150 for determining the difficulty from data obtained 
from the difficulty calculation unit 140, a retry-information transmission unit 
170 for transmitting retry information, and the like. A retry-information 
20 reception unit 180, such as a display device or the like, receives the retry 
information, and displays, for example, a request (or recommendation) to 
again read an original by a scanner or the like to an operator or the like of an 
image processing system. A control unit 200 controls the operations of the 
entire image processing system. 
25 [0032] In the above-described configuration, each functional block 

operates in the following manner. By the operator's operation on an 
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instruction unit (not shown) of the image processing system, image data 
obtained by performing photoelectric scanning of an original set on the 
image-data source 110 is input to the copy-prohibition-object recognition unit 
130 and the difficulty calculation unit 140 via the image -data acquisition unit 
5 120. The difficulty calculation unit 140 calculates difficulty in determination 
whether or not the input image data (may also be attribute data relating to 
the data, or the like) represents a copy-prohibition object. The calculated data 
if of difficulty is output to the difficulty determination unit 150. The difficulty 

r?? determination unit 150 determines the difficulty from data obtained from the 

r\ 10 difficulty calculation unit 140, and outputs the result of the determination to 

01 the control unit 200. When the result of the determination indicates that it is 

s difficult to determine whether or not the image data represents a 

rT copy-prohibition object and it is preferable to again read the original by a 

L^f device for reading (generating) image data, such as a scanner or the like, the 

3 15 control unit 200 outputs a signal to request (or recommend) to again read the 

original by the image-data reading (generating) device to the 
retry-information reception unit 180 via the retryinformation transmission 
unit 170 , in order to obtain an input image for which it is easier to determine 
a copy -prohibition object. 
20 First Embodiment 

[0033] In the following first embodiment of the present invention, a 
description will be provided of a case in which information indicating a 
copy-prohibition object included within an original is formed according to a 
technique called "digital watermark". That is, it is assumed that an original, 
25 serving as a copy-prohibition object, is formed from image data (electronic 
image information) including copy-prohibition-object information generated 
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by embedding second digital information indicating a copy-prohibition object 
in image data (electronic information), serving as first digital information to 
be formed as a printed matter, as a printed matter. 

[0034] The digital watermark may have any appropriate form, such as 
5 invisible digital watermark in which information is embedded in spatial 
frequencies of image data, visible digital watermark in which information is 
embedded according to arrangement of yellow (or yellow-type) dots which are 
difficult to be seen by human eyes, or the like. 

[0035] As described above, in order to extract digital - watermark data 
10 embedded according to the digital-watermark technique, it is necessary to 
obtain consistency between reading and extracting conditions with conditions 
when generating a printed matter in which digital* watermark information is 
embedded (i.e., for example, at what position of image data and at what 
arrangement the information is embedded). 
15 [0036] In general, both of a printing apparatus for generating a printed 
matter from electronic image data, and a scanning direction when reading 
the printed matter (original) by an original-reading device, such as a color 
scanner or the like, are fixed. Accordingly, when reading a printed matter (an 
original) in which digital-watermark information is embedded by an 
20 original-reading device, such as a color scanner or the like, difficulty in 
extraction of digital-watermark information from image data greatly depends 
on in which direction the original is mounted on the surface of an 
original- mount when being read. 

[0037] The first embodiment will now be described in detail with 
25 reference to the drawings. 

[0038] FIG. 2 illustrates an image processing system according to the first 



embodiment. In FIG. 2, there are shown a personal computer 1, serving as a 
computer system, a color image scanner 2, serving as an image input device, 
and a connection cable 3 for exchanging data between the computer system 1 
and the color image scanner 2. 

[0039] FIG. 3 is a block diagram illustrating a principal portion in the 
configuration shown in FIG. 2 as functional modules. In FIG. 3, there are 
shown a CPU (central processing unit) 11, a RAM (random access memory) 
12, a ROM 13, a display control unit 14, a display 15, an operation input 
device 16 including a keyboard, a mouse and the like, an input/output control 
device (hereinafter abbreviated as an "I/O") 17 for connection to the operation 
input unit 16, an external storage device 18, such as a hard-disk device or the 
like, an I/O 19 for connection to the external storage device 18, a bus 20, a 
color image scanner 21, an I/O 22 for connection to an image input device, 
such as a color image scanner or the like, and an interface unit 23 operating 
as an interface with communication means, such as a network or the like. 
[0040] FIG. 4 is a flowchart illustrating operation procedures for 

executing the first embodiment in the configuration shown in FIGS. 2 and 3. 
By storing a program, executable by a computer, which describes procedures 
shown in the flowchart of FIG. 4 in the ROM 13 in advance, or reading a 
program stored in advance in the external storage device 19 into the RAM 
12, and then executing the program by the CPU 11, the processing of the 
flowchart shown in FIG. 4 is performed. 

[0041] In the flowchart shown in FIG. 4, upon start of a series of 
processing, first, in step S10, the CPU 11 instructs the color image scanner 21 
via the I/O 22 to read an original mounted on a reading surface with a 
reading density (for example, 100 dpi (dots per inch)) lower than a finally 
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desired reading density (for example, 400 dpi). The color image scanner 22 
reads the original with the instructed low density. The obtained image data 
with the low density is stored in the RAM 12 via the I/O 22. Although a 
detailed description will be omitted, this reading with the low density is 

5 performed using a known function provided by a color-image "scanner driver. 
[0042] Then, in step S20, a mounting angle 9 of the original on the 
platen of the scanner is calculated from the image data read with the low 
density and stored in the RAM 12 obtained in step S10, and the process 
proceeds to step S30. 

10 [0043] In step S30, it is determined whether or not the read image has an 
angle (at least a predetermined angle 0th) at which detection of a 
copy"prohibition image is difficult in recognition/determination processing 
with a relatively small amount of calculation operations. If the result of the 
determination in step S30 is affirmative, the process proceeds to step S40. If 

15 the result of the determination is negative, the process proceeds to step S50, 
[0044] In step S50, the CPU 11 instructs the color image scanner 21 to 
read the original mounted on the reading surface with the finally desired 
reading density (for example, 400 dpi), via the I/O 22. The color image 
scanner 21 reads the original with the instructed reading density. The 

20 obtained image data is stored into the RAM 12 via the I/O 22. Upon 
completion of step S50, the process proceeds to step S60. 

[0045] In step S60, the presence of characteristics of a copy-prohibition 
object in the image data obtained in step S50 is checked. The process then 
proceeds to step S70. 
25 [0046] In step S70 ? it is determined whether or not the image is a 
copy-prohibition image based on the result of the check in step S60. If the 
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result of the determination in step S70 is affirmative, the process proceeds to 
step S80. If the result of the determination in step S70 is negative, the 
process proceeds to step S90. 

[0047] In step S80, abnormal image data is output. That is, as described 

5 above, an abnormal image (other than the read image data) represented by 
(l) image data entirely painted with a certain color, (2) image data obtained 
by superposing a certain symbol or figure on the image, (3) image data in 
which the color or the image size is changed, or a combination of these image 
data is output. Such an abnormal image can be easily generated by executing 

10 a program module for performing known appropriate image processing in 
which the read image stored in the RAM 12 is input, by the CPU 11. The 
generated abnormal image data is output as an image data file to the 
external storage device 18 via the I/O 19. Upon completion of step S80, the 
series of processing is terminated. 

15 [0048] In step S90, the image data read in step S50 is output to the 
external storage device 18 via the I/O 19 as an image data file. Upon 
completion of step S80, the series of processing is terminated. 
[0049] In step S40, the CPU 11 outputs a signal indicating that the 
mounting angle 6 of the original on the reading surface of the scanner is an 

20 angle (at least 0 th) at which detection of a copy-prohibition image is 
difficult, and requesting to again read the original by changing the mounting 
state, to the display device 15 via the display control unit 14. Upon 
completion of step S80, the series of processing is terminated. In accordance 
with the result of the output, the display device 15 displays the mounting 

25 angle of the original in the form of an image. 

[0050] In the above-described step S80, the operation that (4) image data 
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is not output at all may, of course, be performed instead of outputting a 
certain image data file. The operation that (5) a signal indicating warning 
that the original is a copy-prohibition object is output to the display device 15 
via the display control unit 14 may of course, also be performed. 

5 [0051] In the processing of calculating the mounting angle of the original 
on the original-reading surface performed in step S20, the angle of the 
original is detected by detecting the positions of edges of the original for each 
scanning line by detecting the difference between the pixel density value 
when reading the platen cover of the scanner and the pixel density value 

10 when reading the background portion of the original, and detecting the 
positions of four corners of the original based on information relating to 
changes in the positions of edges of the original. 

[00521 The check of the characteristics of a copy-prohibition object in step 
S60 is performed by extracting the characteristics from image data obtained 

15 by performing photoelectric scanning of the original, serving as a printed 
matter including information relating to a copy-prohibition object using the 
above-described digital-watermark technique, by the scanner. 
[0053] In step 370, it is determined whether or not information relating 
to a copy-prohibition object has been extracted in step S60. If the result of the 

20 determination in step S70 is negative, the process proceeds to step S90. If the 
result of the determination in step S70 is affirmative, the process proceeds to 
step S80. 

[0054] The determination of the mounting angle in step S30 is realized by 
comparing the threshold of the angle at which extraction of 
25 digital-watermark information performed in step S60 becomes difficult with 
the angle 0th predetermined by an experiment or the like. 
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[0055] According to the above-described configuration, the problem that, 
when recognition/determination processing with a relatively small amount of 
calculation operations is adopted, an erroneous recognition determination 
may be obtained depending on the mounting angle of the original can be 
5 solved by again reading the original with an angle at which precise 
determination can be performed by the user's operation. 
Second Embodiment 

[0056] Although in the above-described first embodiment, the check of the 
characteristics of a copy-prohibition object in step S60 is performed by 
10 extracting the characteristics from image data obtained by performing 
photoelectric scanning of the original, serving as a printed matter including 
copy-prohibition-object information using the digital-watermark technique, 
any other appropriate approach may also be adopted. The check of the 
characteristics of a copy-prohibition object in step S60 may be performed by 
15 comparing a color-spectrum distribution of image data obtained by scanning 
the original with data registered in advance in the ROM 13, based on each 
pixel value (a set of R, G and B values corresponding to three-color signals) in 
the image data, or comparing the synthetic image pattern of a part or the 
entirety of the original with pattern data registered in advance in a ROM or 
20 the like. In this case, in step S70, the evaluation value (the sum of the 
absolute values of difference values, the cross -correlation value between 
distributions, or the like) is determined based on a predetermined threshold 
(for example, if the sum of the absolute values of difference values does not 
exceed the threshold, the image is determined to be a copy-prohibition object, 
25 and if the sum exceeds the threshold, the image is determined not to be a 
copy-prohibition object, or if the cross-correlation value exceeds the threshold, 



the image is determined to be a copy -prohibition object, and if the 
cross-correlation value does not exceed the threshold, the image is 
determined not to be a copy-prohibition object). 
Third Embodiment 

[0057] In the above-described first and second embodiments, the 

calculation of the mounting angle 0 of the original (calculation of the 
difficulty in extraction of copy-prohibition-object information) is performed in 
steps S20 and S30, and determination whether or not extraction of 
copy-prohibition-object information is difficult (determination of difficulty) is 
performed from the obtained angle. However, any other appropriate approach 
may be adopted. The process of obtaining the mounting angle of the original 
in step S20 may be replaced by processing of obtaining the positions of four 
corners of the original in the digital image obtained by reading the original on 
the original-mount (platen) and calculating the mounting position of the 
original (the coordinates of the four corners of the original) as shown in step 
S21 of FIG. 5, and the process of step S30 in FIG. 4 may be replaced by 
determination whether or not the mounting position of the original coincides 
with a predetermined standard position as shown in step S31 of FIG. 5. If the 
result of the determination in step S31 is affirmative, the process eventually 
proceeds to step S70 assuming that the determination of a copy-prohibition 
object is not difficult. If the result of the determination in step S31 is negative, 
the process proceeds to step S41. The process of outputting a signal 
requesting to change the mounting angle of the original in step S40 of FIG. 4 
is replaced by the process of outputting a signal requesting to change the 
mounting position of the original as shown in step S41 of FIG. 5. Other 
portions are entirely the same as in the first or second embodiment. 
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[0058] In step S31, as shown in FIG. 6, when the coordinate values of four 
corners Pa, Pb, Pc and Pd of the original obtained in step S21 are represented 
by (xa, ya), (xb, yb), (xc, yc) and (xd, yd), respectively, it is determined 
whether or not conditions of either one of (xa < xO and ya < yO) and (xb < xO 

5 and (yb < yO), and | ya - yb 1 < yth and | xa - xc | < xth are satisfied. Each of 
xO, yO, xth and yth is a predetermined sufficiently small nonnegative integer. 
[0059] According to such a configuration, it is possible to detect not only 
whether or not the mounting angle is to be changed, but also whether or not 
the mounting position is to be changed, and therefore to urge the operator to 

10 provide an original- mounting state in which the determination is easier. As a 
result, it is possible to realize scanning of an image by precisely determining 
an original in a shorter time. 
Fourth Embodiment 

[0060] Although in the above-described first through third embodiments, 
15 the calculation of difficulty in determination whether or not an image is a 
copy-prohibition object shown in step S20 or S21 is performed from an image 
obtained by pre-scanning shown in step S10, the present invention is not 
limited to such an approach. That is, actual scanning performed in step S50 
may be performed in step S10. The image read in this actual scanning may be 
20 stored in the RAM 12 or the external storage device 18, and the stored image 
may be processed at the processing starting from step S60. 
[0061] In this case, although it is necessary to provide storage means 
having a capacity sufficient enough to store the entire scanned image within 
the apparatus, it is possible to shorten the time required for pre-scanning. 
25 Fifth Embodiment 

[0062] Although in the above-described first through fourth embodiments, 
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the characteristics of a copy-prohibition object are checked for the image read 
by the scanner, the present invention is not limited to such an approach. 
[0063] That is, the object to be checked is not limited to a color image read 
by a color scanner. For example, color-image data may be obtained via the 

5 interface unit 23 for a communication medium, such as a network or the like, 
shown in FIG. 3, or may be obtained from a removable storage medium (such 
as a smart medium, a compact flash memory, a magnetooptical disk or the 
like) storing the image data, by mounting it in a driving device (not shown) 
connected to the image processing system. 

10 [0064] In this case, the acquisition of image data in steps S10 and S50 
may be replaced by reading of image data stored in the removable storage 
medium mounted in the driving device into the RAM 12 via an I/O for the 
driving device of the storage medium. 

[0065] The acquisition of image data in steps S10 and S50 may, of course, 
15 also be replaced by acquisition of image data via an interface unit for 
communication means, such as an Internet network. In this case, retry 
information described as a signal requesting to change the mounting angle or 
the position of the original in step S40 or S41, respectively, may be replaced, 
for example, by a signal recommending to reform an image to be input to a 
20 display device, such as the display 15 or the like of the image processing 
system, and acquire the formed image. 
Sixth Embodiment 

[0066] Although in the above-described first through fifth embodiments, 
image data is output to the external storage device 18 (a hard disk or the like 
25 within the image processing system) via the I/O 19 as an image data file 
whether the image data is output as normal image data or abnormal image 
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data, the present invention is not limited to such an approach. 
[0067] That is, the image data may be output to a color printer connected 
to the image processing apparatus, or to the outside of the image processing 
apparatus via an interface unit for a communication medium, such as a 

5 network or the like. 

[0068] FIG. 7 illustrates an image processing system in such a case. In 
FIG. 7, as in the case of FIG. 2, a personal computer 1 serves as a computer 
system. A color printer 4 serves as an image output apparatus. A connection 
cable 5 is used for exchanging data between the computer system 1 and the 

10 color printer 4. 

[0069] FIG. 8 is a block diagram illustrating a principal portion in the 
configuration of FIG. 7 as functional modules. In FIG. 8, reference numeral 
25 represents a connection I/O for an image output apparatus, such as a color 
printer or the like. Reference numeral 24 represents a color printer. Other 

15 components are entirely the same as in the case of FIG. 3. 

[0070] In this case, output of image data in step S80 or S90 in the 
flowchart of FIG. 4 or 5 is realized by output of image data to the color printer 
24 connected to the image processing system via the I/O 25. 
[0071] Output of image data in step S80 or S90 may, of course, be realized 

20 by output of image data to the outside of the system via an interface unit for 
communication means, such as an Internet network or the like. 
Seventh Embodiment 

[0072] Although in the above-described first through sixth embodiments, 
the presence of characteristics indicating whether or not input image data 
25 represents a copy-prohibition object is determined, the present invention is 
not limited to such an approach. 
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[0073] That is, The present invention may also be applied to a case in 
which sub -information relating to image data itself included within the 
image data is detected, instead of a case of determining whether or not the 
image data represents a copy-prohibition object. For example, the present 

5 invention may also be applied to a case in which the presence of copyright 
information (sub-information) is confirmed from a hard-copy image for an 
image in which copyright information, serving as second digital information 
(sub -information), is mixed in original image data, serving as first digital 
information (main information), using the digital* watermark technique in 

10 order to claim the copyright of the user who has formed the image. By 
calculating difficulty in extraction of the characteristics of the image as 
described above, and determining whether or not retry of input of the image 
is to be urged, based on the result of the calculation, it is, of course, possible 
to construct an image processing system which can easily extract the 

15 characteristics of the image. 

[0074] In this case, the copy-prohibition-object recognition unit 130 
shown in FIG. 1 may be replaced by an image-characteristics extraction unit 
131 shown in FIG. 9. Since other components shown in FIG. 9 operate in the 
entirely same manner as in the case of FIG. 1, further detailed description 

20 thereof will be omitted. In accordance with this modification, as shown in FIG. 
10, the processing in step S60 in FIG. 4 or 5 is replaced by processing of 
extracting image characteristics (sub -information) in step S61 of FIG. 10, and 
the processing in step S70 in FIG. 4 or 5 is replaced by determination 
processing in step S71 of FIG. 10, and the same processing as in FIG. 4 or 5 is 

25 performed after determination in step S71. 

[0075] In the seventh embodiment, step S80 is not necessarily processing 
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of outputting an abnormal image. For example, extracted copyright 
information, serving as sub-information, may be displayed on a display or the 
like via the display control unit 14. Similarly, step S90 may be processing of 
displaying the fact of absence of copyright information, serving as 
5 sub-information, on a display or the like via the display control unit 14, 
instead of outputting of normal image data. 

[0076] A processing method of storing a program for operating the 
configuration of each of the above -described embodiments in a storage 
medium so as to realize the functions of the above -de scribed embodiments, 
10 reading the program stored in the storage medium as codes, and executing 
the codes by means of a computer is also included within the scope of the 
embodiments, and the storage medium storing the program is also included 
in the embodiments. 

[0077] A floppy disk, a hard disk, an optical disk, a magnetooptical disk, a 
15 CD(compact disc)-ROM, a magnetic tape, a nonvolatile memory card, or a 
semiconductor ROM may be used as the storage medium. 

[0078] In addition to execution of processing by a program stored in the 
above-described storage medium, execution of the operations of the 
above-described embodiments by operating in an OS (operating system) in 
20 cooperation with the functions of other software and expansion board is also 
included within the scope of the embodiments. 

[0079] The individual components shown in outline or designated by 
blocks in the drawings are all well known in the image processing apparatus 
arts and their specific construction and operation are not critical to the 
25 operation or the best mode for carrying out the invention. 

[0080] While the present invention has been described with respect to 
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what are presently considered to be the preferred embodiments, it is to be 
understood that the invention is not limited to the disclosed embodiments. To 
the contrary, the present invention is intended to cover various modifications 
and equivalent arrangements included within the spirit and scope of the 
5 appended claims. The scope of the following claims is to be accorded the 
broadest interpretation so as to encompass all such modifications and 
equivalent structures and functions. 
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